1839, "tall hat;" also used synechdochically for men who wear such hats; figurative meaning "swelled head" is from 1923. Drum set sense is from 1934.
hierophantic
hierophobia
hi-fi
higgledy-piggledy
high
high hat
high horse
high seas
highball
high-born
highboy